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System for Stereoscopic Viewing 

of an Image 

Cross Reference to Related Applications 

This application claims benefit of Provisional applications entitled "Devices and 
Methods for Stereoscopic Viewing", serial no. 60/240,254, filed on October 13, 
2000, and "Devices and Methods for Stereoscopic Viewing", serial no. 60/241 ,777, 
filed on October 1 9, 2000. 

Field of the Invention 

The present invention relates to techniques for displaying and viewing 
stereoscopic images, and more particularly, to techniques for displaying and 
viewing conventional stereoscopic image pairs presented upon commonly available 
surfaces and media. More particularly, the present invention relates to the design 
and use of an associated viewing apparatus for viewing such images. Still more 
particularly, the present invention relates to systems and methods for maximizing, 
where possible, the viewer's sense of immersion into the viewed image. 

Background of Invention 

[0001] To simulate ordinary binocular stereoscopic vision, the basic task is to present 
to each of the viewer's eyes a 2-dimensional image depicting the respective left- 
or right-eyed view of the desired scene. When the two images sufficiently closely 
match each other, the brain's binocular vision melds the two images into a single 
3-dimensional one. 

[0002] For consumer-level applications, it is desirable to present the pair of 2D 

images using conventional graphic media, such as a printed page, or TV, video-, or 
movie-screens. For conventional media to deliver to the eyes such a pair of 
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images, a method is needed for viewing two proximate images, one with each eye. 
(Only proximate non-overlapping images are considered here, because only such 
"ordinarily" rendered images typically exploit fully a medium's graphic capabilities, 
which is an object of the present invention.) 

[0003] To facilitate the viewing of such a pair of proximate images, existing methods 
have used binocular mirror-systems to displace each eye's optical axis so that it 
centers perpendicularly upon its respective image. It is usual to arrange such a pair 
of images side-by-side, but also possible instead to place one image above the 
other. As the left-right symmetry inherent in stereoscopic vision would suggest, 
existing methods and viewing-devices typically treat both eyes identically (albeit 
reciprocally). 

Summary of Invention 

[0004] Taking the above into consideration, an object of the present invention is the 
low-cost, convenient presentation and viewing of high-quality stereoscopic images 
using a wide variety of commonly available graphic media. 

[0005] The present invention provides a new approach to displaying and viewing a 
pair of conventional stereoscopic images on ordinary media. As with previous 
methods, the images are placed proximate to each other. 

[0006] In one illustrative embodiment, the images are placed one above the other. 

Both eyes gaze nominally at the bottom image, but one of the eyes actually looks 
into a mirror apparatus that deflects that eye's gaze upward to view the top image 
instead. Note that, rather than being fully "displaced" upward so as to effectively 
view the top image perpendicularly (i.e., head-on), the gaze is instead primarily 
"re-angled" (i.e., turned) to aim somewhat upward, and thus doesn't remain exactly 
perpendicular to the image-surface. 

[0007] 

Naturally, the upward -gazing eye's respective image therefore appears as 
somewhat distorted. Because it is being viewed from "below", that image appears 
to be disproportionately larger at the bottom. And, especially because the 
apparatus's mirrors further lengthen that images eye-to-image optical path, the 
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image appears smaller overall to its respective eye. The resulting mismatch with 
the other eye's normally-viewed image interferes with the stereoscopic melding of 
the two images. The present invention prescribes two remedies for such 
disparities: (1) If the overall eye-to-image distance is made sufficiently large, then 
the mismatch becomes negligible, because the viewer's brain ignores it and melds 
the two images adequately; (2) The image can be rendered as already "reverse- 
distorted", to compensate for any distorting perspective. Thereby, any given 
portion of the image is made to "coincide" with its corresponding portion in the 
other, normally viewed, image. (This works because each eye, considered 
separately, perceives primarily 2-dimensionally, largely ignoring any intra-image 
depth variance.) 

[0008] Note that viewing the image from any off-center perspective (and not merely 
from below-center) incurs similar distortions, which in turn are subject to similar 
remedies. 

[0009] Meanwhile, one advantage of the present invention is already apparent: Only 
one of the viewer's eyes needs to be optically manipulated by the viewing-device 
whose design may thus be correspondingly smaller (e.g., by half). 

[0010] The above and other objects, features, and advantages of the present invention 
will become apparent from the following description, taken in conjunction with the 
accompanying drawings which illustrate preferred embodiments of the present 
invention by way of example. 

Brief Description of Drawings 

[001 1] FIGS. 1 A, IB, and 1C illustrate a horizontally arranged stereoscopic image-pair, 
and contrast viewing-devices of the prior art and of the present invention. 

[001 2] FIGS. 2A, 2B, and 2C illustrate a vertically arranged stereoscopic image-pair, 
and contrast viewing-devices of the prior art and of the present invention. 

[001 3] FIGS. 3A, 3B, 3C, and 3D demonstrate an advantage in flexibility of the present 
invention over the prior art. 
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[001 4] FIG. 4 depicts an embodiment wherein the viewer's gaze is nominally toward 
the more distant image. 

[001 5] FIGS. 5A, 5B, and 5C illustrate the visual distortion known as "keystoning". 

[001 6] FIG. 6A, 6B, 6C, and 6D exemplify how an image may be "reverse-distorted" to 
compensate for distortion caused by an elevated viewing perspective. 

[001 7] FIGS. 7 A and 7B (and 7C) show side-views of an example (two-)mirror viewing- 
device and an example prism viewing-device. 

[001 8] FIG. 8 shows how a two-eyed viewing-device deflects each eye's optical path 
for a vertically arranged image-pair. 

[001 9] FIG. 9A, 9B, 9C, and 9D exemplify how an image may be "reverse-distorted" to 
compensate for close-perspective distortion (a.k.a. "barrel-distortion"). 

[0020] FIGS. 1 OA, 1 0B, and 1 0C illustrate a ("poster"-sized) embodiment wherein one 
image is "reverse-distorted". 

[0021] FIGS. 1 1A, 1 1B, and 1 1C illustrate an embodiment wherein both images are 
"reverse-distorted". 

[0022] FIGS. 1 2A-1 2G illustrate an embodiment wherein "reverse-distorting" 
counteracts distortion inherent in the display surface. 

Detailed Description 

[0023] Certain preferred embodiments of the present invention will now be described 
in conjunction with the accompanying drawings. 

[0024] This description refers to the display of a "conventional stereoscopic pair of 
images". Such an image pair is two normally oriented pictures of a single subject, 
representing the perspective of a hypothetical viewer's left- and right-eye, 
respectively. (The prior art displays the two images usually side-by-side, but 
sometimes instead one above the other.) 

[0025] description also refers to a "generally flat surface" (upon which the image 
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pair is displayed). Such media are those typically used for the display of 2- 
dimensional images, i.e., TV, movies, video-game, computer screen, electronic 
display, printed page, drawing, painting, mural, etc. (Note that specific media may 
be mentioned as examples when presenting embodiments. Notwithstanding, the 
present invention applies to all such media and surfaces.) 

[0026] In the first preferred embodiment, a conventional stereoscopic image-pair is 
displayed on an ordinary graphic surface (such as a printed page), with the images 
being placed proximate and side-by-side, as in FIG. 1A. Using prior art, the 
image-pair is typically viewed as exemplified in FIG. 1 B, wherein the viewer 14, 
positioned level with and between the two images, employs a viewing-device 
whose mirrors (1 0 thru 1 3) fully displace sideways each eye's optical axis, so that it 
targets perpendicularly the center of its respective image. By contrast, the present 
invention is exemplified in FIG. 1 C, wherein the viewer 1 9, whose left eye is 
centered before the left image 1 7, employs a viewing-device whose mirrors (1 5 
and 1 6) re-angle the right eye's optical axis to target the center of the right image 
1 8, albeit not exactly perpendicularly. (The larger the viewer-to-image distance, 
the more nearly perpendicular is the re-angled eye's view.) 

[0027] In a variation of the first preferred embodiment, the image-pair is displayed 
with one eye's image being placed proximate and above the other eye's image, as 
in FIG. 2A. Using prior art, the image-pair is typically viewed as exemplified in FIG. 
2B, wherein the viewer 24, positioned level with and between the two images (i.e., 
centered upon the boundary separating them), employs a viewing-device whose 
mirrors (20 thru 23) raise/lower each eye's optical axis, so that it targets 
perpendicularly the center of its respective image. By contrast, the present 
invention is exemplified in FIG. 2C, wherein the viewer 29, whose left eye is 
centered before the bottom image 27, employs a viewing-device whose mirrors (25 
and 26) re-angle the right eye's optical axis to target the center of the top image 
28 (again not exactly perpendicularly). Obviously, either eye's optical axis can be 
re-angled, and the non-re-angled eye can gaze at either image, with the 
appropriately designed and used viewing device of this invention. 
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[0028] An advantage of the present invention is exemplified in FIG 3: Using the prior 
art shown in FIG 3A, each image must be no larger (in the interocular direction 31) 
than the interocular distance 30 effected by the viewing-device. However, using 
the present invention (shown in FIG. 3B), larger images may simply be viewed from 
farther away (as in FIG. 3C) or, alternatively, a mirror of the viewing-device may be 
rotated to increase the degree of re-angling (as in FIG. 3D). This flexibility 
becomes especially noteworthy when, for example, an image-pair is broadcast 
onto variously sized TVs, or is offset-printed larger (e.g., for higher resolution, or 
for many simultaneous viewers). 

[0029] An illustrative variation of the first preferred embodiment is shown in FIG. 4A. 
Here, the viewer's eyes now are level with the top image 40. However, both eyes 
gaze downward toward the bottom image 41 . Meanwhile, a viewing-device 42 re- 
angles upward one eye's optical axis 43 so that it targets the center of the top 
image 40. Such a viewing configuration may allow the two images' optical paths to 
be more nearly equal in length. This is because the top image's optical path 43, 
ostensibly shorter than the bottom image's 44, may actually include a hidden 
"detour" within the viewing-device itself. (As exemplified in FIG. 4B, mirrors 45 and 
46 could cause such a detour.) 

[0030] A second preferred embodiment is now described, wherein a deliberate 
reshaping (e.g., "reverse-distorting") of the bottom image is applied. 

[0031] The preceding embodiments work well when the eye-to-image distance is 
relatively large. But when the eye-to-image distance is not so large, certain 
apparent distortions of an image can be worsened. (As an extreme example, the 
view of a 1 -foot-square image from 1 0 feet away is relatively undisturbed by, say, 
shifting the head a few inches off-center. But the view of the same image from 
only 1 foot away is quite distorted to begin with, and becomes much worse if the 
head is thus shifted.) 



[0032] 



A common such distortion is illustrated in FIG. 5. An image that's rectangular 
when viewed from head-on (FIG. 5A), seems to become trapezoidal when viewed 
from the side of center (FIG. SB) or from above center (FIG. 5C). This sort of 
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distortion is called "keystoning". 

[0033] Another simple distortion occurs whenever one eye's optical path is longer 

than the other eye's (as in, for example, FIGS. 1C and 2C.) Then, the more "distant" 
image naturally appears smaller than the other. 

[0034] To compensate for such distortions, the second preferred embodiment 

deliberately and proportionately reshapes (i.e., reverse-distorts) one image prior to 
rendering. This reshaping effectively moves each point of the original image to its 
corresponding-when-viewed point in the reshaped-and-rendered image. (One 
example method of effecting such a reshaping is to project the initial image onto a 
tilted surface. Another example method is to simulate such a projection by 
manipulating the pixels of a computer-graphics file of the image.) 

[0035] When the appropriately reshaped image is viewed from the anticipated 

distorting perspective, the image seems to transform back into its original normal 
aspect. This effect is illustrated in FIG. 6. The image we wish the viewer (to seem) 
to see is a simple rectangle FIG. 6A. But when such an image is viewed from above 
head-on, it appears as a trapezoid FIG. 6B. This particular distortion is called 
"keystoning". So, to counteract the anticipated keystoning, we first "reverse- 
distort" the image to resemble the reciprocally keystoned trapezoid FIG. 6C, and 
we display that reverse-distorted image instead. When the reverse-distorted image 
FIG. 6C is viewed from above head-on, it appears to the viewer as the original 
simple rectangle FIG. 6D (and 6A). 

[0036] Using an upward-deflection configuration as an example (e.g., FIG. 2C), two 

preferred embodiments of the viewing-device are diagrammed in FIGS. 7 A and 7B. 

[0037] 

The device shown in FIG. 7A comprises two proximate flat mirrors 70 and 71 , 
each tilted about a horizontal axis that parallels the image-plane. Mirror-surface 
70 is tilted to 45-degrees. Mirror-surface 71 is tilted to slightly vertical of 45- 
degrees. Because the device "obstructs" only the right-eye, the left-eye's optical 
path 72 proceeds unimpeded. Meanwhile, because of the slightly mismatched 
mirror-angles, the right-eye's optical path 73 is deflected upward at a desired 
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angle. (It is also slightly raised, i.e., displaced, as though the right-eye were higher 
than the left.) 

[0038] (FIG. 7C illustrates a further characteristic of this embodiment of a two-mirror 
device: The embodiment intends merely to re-angle the optical axis, but to 
lengthen it only minimally. Therefore, the vertical distance between mirrors 76 and 
77 is just large enough to allow clearance for mirror 77's field-of-view 75, i.e., at 
point 78. This also helps minimize size of the device required for a given field of 
view.) 

[0039] Rather than using mirrors to deflect the optical path upward, the device shown 
in FIG. 7B uses a simple prism 74 instead. Similar to FIG. 7A, the prism "obstructs" 
only the right-eye, deflecting its optical path upward at a desired angle. 

[0040] Other embodiments of the viewing device may employ additional optics, such 
as focus-aiding lenses, and more complex prism optics (e.g., compound serial or 
Fresnel-type prisms). 

[0041] A further embodiment of the viewing-device features mirrors whose positions 
and/or angles may be adjusted by the viewer, so that a single device may be used 
to view a variety of differently arranged and sized image-pairs, and to view them 
from various distances and angles. 

[0042] In yet a further embodiment of both the viewing-device and the display of 

image-pairs, each of the viewer's eyes has a corresponding mirror-pair within the 
viewing-device. Thus, for a vertically arranged image-pair, as in FIG. 8, the viewer 
80, now gazes nominally at the center of both images (i.e., at a point 84 between 
them), through a viewing-device 81 that "obstructs" each eye with its own mirror- 
pair (or prism). Thus, one eye's optical path 83 is re-angled upward to the top 
image, and the other eye's optical path 82 is re-angled downward to the bottom 
image. Note that the use of two mirror-pairs does gain some advantages (e.g., 
from treating the two eyes symmetrically), but deflecting both eyes' gazes tends to 
disorient the viewer . 



[0043] 



The "reverse-distorting" of images can be used to compensate not only for 
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"keystoning" as described above, but for other distortions as well. For example, 
even when the eye gazes head-on into the center of a rectangular image, some 
distortion occurs because the rectangle's corners are farther than its center from 
the viewing eye. This is particularly acute when the eye is close to the image. (Such 
an effect is called "barrel distortion"). To illustrate, the image we wish the viewer 
(to seem) to see is a simple rectangle FIG. 9A. But when such an image is viewed 
from very close, it appears as a "barrel" FIG.9B (i.e., with bulging sides). So, to 
counteract the anticipated distortion, we first "reverse-distort" the image to 
resemble a "pincushion" FIG. 9C f and we display that reverse-distorted image 
instead. When the reverse-distorted image is viewed from very close, it appears to 
the viewer as the original simple rectangle FIG. 9D (and 9A). 

[0044] Still other distortions may be counteracted in this manner, including distortions 
inherent in the original image (e.g., the barrel-distortion caused by some camera 
lenses), distortions introduced by the viewing-device itself (e.g., the tendency of 
simple prisms to curve straight lines), and distortions inherent in the rendering 
medium (e.g., the convex screen of many TVs). 

[0045] . t) . „ , . 

Note that the reverse-distorting technique employs an aspect of the present 

invention that can be stated and applied more generally: Because each of the two 

images is viewed with a single eye (i.e., 2-dimensionally), an image can be 

considered to comprise its respective eye's field-of-view, where each "pixel" of the 

field corresponds to a pixel on the physical display-surface, with relatively little 

regard for either the distance to the display-pixel or the distance to its 

stereoscopically viewed "actual" pixel. Thus it can be said that the present 

invention employs a conveniently flat display-surface to "paint" separately upon 

the virtual sphere that surrounds each eye. And, "reverse-distorting" (i.e., prior to 

display) is a matter of maneuvering an image's pixels so that, upon display, each 

pixel will appear in its proper position on the virtual sphere. (The concept of 

discrete pixels is used merely metaphorically, and is not essential to the present 

invention.). FIGS. 10A, 10B, and 10C show an embodiment that exploits certain 

advantages of the present invention. The display-surface is a large, "poster"-sized 

print 100, on which appear a left-eye image 101 and a "reverse-distorted" right- 
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eye image 102. The large size of the displayed images allows the viewer 103, 
(using the viewing-device 104) to view the (normal) left-eye image 105 from quite 
close (like sitting in the front row at the movies). Because of the resulting wide 
view-angle 107, the viewer 106 enjoys a substantially immersive stereoscopic 
experience. Furthermore, the large display-surface of this embodiment facilitates 
the presentation of very-high-resolution images, which enhances the viewer's 
sense of recreated reality. 

[0046] FIGS. 1 1 A and 1 1 B show a similar embodiment. Here, the viewer's position is 

level with the boundary between the two images 1 1 1 and 1 1 2 (rather than centered 
on one of them as in FIG. 1 0B). Accordingly, the viewer's gaze 1 1 3 is nominally 
upward toward the top image (as the viewing-device 1 14 again turns one eye's 
gaze downward to the bottom image). To present their respective rectangular 
aspects to this embodiment's viewer position, both images are "reverse-distorted", 
as shown. 

[0047] A further embodiment exemplifies how "pre-distorting" an image may 

compensate for distortion inherent in a display surface. Rather than being perfectly 
flat (FIG. 1 2A), many TVs and other CRT display surfaces are convex (FIG. 1 2B). 
Therefore, a vertically arranged image-pair (FIG. 1 2C) displayed normally may 
appear to "bow" outward (especially at top and bottom in the example shown in 
FIG. 1 2D). The resulting mismatch may be great enough to thwart a stereoscopic 
meld (FIG. 1 2E). By "reverse-distorting" the images (as shown in FIG. 1 2F) to 
counteract the anticipated distortion, the images appear to have a more 
"normal" (and matching) aspect when viewed, as in FIG. 12G. 
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